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Abstract 

We solve two stochastic control problems in which a player tries to minimize or maximize 
the exit time from an interval of a Brownian particle, by controlling its drift. The player can 
change from one drift to another but is subject to a switching cost. In each problem, the 
value function is written as the solution of a free boundary problem involving second order 
ordinary differential equations, in which the unknown boundaries are found by applying the 
principle of smooth fit. For both problems, we compute the value function and we exhibit 
the optimal strategy, whose form depends on the magnitude of the switching cost. We also 
| prove the generic uniqueness of the optimal strategy. 

1 Description of the problem 

Consider a game in which the player's goal is to force a Brownian particle out of the interval [0, 1] 
as quickly as possible. At each instant, the player selects one of two opposite constant forces, 
either upwards or downwards, which adds or subtracts a constant drift [i to the Brownian motion. 
The player is allowed to switch between the two forces at any time, but at each switch, he incurs 
a penalty of c units of time. The goal is to find a strategy that minimizes the expected penalized 
time, that is, the sum of the time needed for the particle to exit the interval and the switching 
penalties ("optimal expulsion problem"). 

We also solve the "opposite" problem, in which the goal is to keep the particle inside [0, 1] 
for as long as possible, subject to the same kind of switching penalty, which is now subtracted 
from the time to exit the interval ("optimal confinement problem"). 

Let (Bt)t^o be a standard Brownian motion, defined on a probability space (0, J 7 , P), such 
that Bq = a.s., let (J r t)t>o be its natural filtration and let A denote the set of all J^-adapted 
processes that are right continuous, piecewise constant and take values in {—1, 1}. The elements 
of A are the strategies available to the player. We consider a control model in which the system's 
state is given by the stochastic differential equation 



<N 



dXf = Atfidt + dBt, (1.1) 



where A = (-At)^o G A and \i G R+ is a given positive constant. The random variable X A 
^ " denotes the position of the particle at time t if the player is using the strategy A, and At gives 

the direction in which the player is pushing at time t. The initial conditions are given by a family 
of probability measures {Px,a> x G [0, 1], a G {±1}} defined by T x , a {X A = x, A - = a) = 1, with 
associated expectations K x<a . Here, Ao_ is the drift that applies just before time 0, and which 
can change at time precisely, if desirable. Let c > be the switching cost and let 

N t (A) = ${se [0,t] :A a -?A a } (1.2) 

be the number of switches of drift of the process X A up to time t. Notice that Nq(A) > is 
possible. The cost function for the minimization (resp. maximization) problem is then given by 

J c (x,a,A) =E x Jt a + cN t a(A)), 
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respectively, 



jr x (x,a,A) = E x>a (r A - cN t a(A)) 



where 



t A =inf{t ^ : X A £]0,1[} 



(1.3) 



and the value functions are respectively given by 



V c (x,a) = mf^ J c (x, a, A), 
V c max (x,a) = sup J™ ax (x, a, A). 



(1.4) 



(1.5) 



The goal is then to compute these value functions and to find optimal controls A* G A and 
G* € A such that V c (z, a) = J c (x, a, A*) and V c max (x, a) = J 6 max (x, a, G*), for all c G R+ and for 
all [i G R* + . 

These two problems can be viewed in the context of various applications, such as maintaining 
an inventory between certain bounds by controlling the production rate, or maintaining an 
insurance company's capital reserve between two bounds by controlling the insurance premium. 
In certain asymptotic limits, these quantities may behave like a Brownian motion, and a change 
of production rate or of premium may entail a switching cost. There is a well-developed literature 
for such control problems, including [H [5j [19] . The most common types of costs are terminal 
costs and running costs, whereas here, we deal with a switching cost. This falls into the theory 
of impulse control, as described for instance in [10\ Chapter 6]. 

In order to solve (|1.4p or (|1.5p . we formulate a free boundary problem for the value function. 
This approach has a long history, going back to [21 El [TUJ [T7] . and, more recently, [T2]. These 
references use the so-called principle of smooth fit (see for example [X2^ p. 147] and |13[ Section 
5.3.4]) to determine a unique solution to the free boundary problem. This method has proven 
to be quite successful, including for instance in the problem of optimal switching (without cost) 
between two Brownian motions [8]. We also use this method here. 

There are several papers which treat problems close to ours. For instance, Prokhorov [2] 
solves a similar problem but without cost penalty, and Mandl [9] treats a control problem for a 
Brownian motion under a constraint on the number of switchings. If there is no switching cost 
(c = 0), then the solution of (jl.4p and (jl.5p is well-known (see p. 167-168]). 

This paper is organized as follows. In Section [21 we state the free boundary problems 
and their solutions, and we identify the optimal controls. These solutions are explicit up to 
the resolution of two transcendental equations. It turns out that the structure of the optimal 
solution depends on whether or not c is smaller than a critical value c*(/i), which is given 
explicitly in (|2.2|) . In Section [31 we show how the free boundary problems are solved and we 
prove that their solutions are indeed the value functions. Finally, in Section U we show that the 
optimal solutions are generically unique (except in the critical case c = c*(/i), where there are 
two distinct optimal solutions), and we study the limiting case c | 0. 

2 Solution of the problem 

In this section, we present the solution of both problems (|1.4p and (jl.5|) . In order to formulate a 
free boundary problem for the value function, we will assume that the solution will satisfy three 
properties. The validity of these properties will be established in Section [3] 

2.1 Properties of the solution 

Property 1. The optimal strategy is symmetric with respect to the initial drift and the value 
functions satisfy V c (x, a) = V c (l — x, —a) and V^ X3X {x, a) = T^, max (l — x, —a), for all x G [0, 1] 
and a G {±1}. 
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Property 2. There exists a critical value c*(/x) > for which the optimal strategy is the con- 
stant strategy if c > c* (li) . 



Indeed, for a given //, the expected exit time of a Brownian motion with constant drift ±/z 
is a bounded function of the starting point x G [0, 1]. Thus, if the cost exceeds a certain value, 
then a reasonable player will never pay this cost to change the initial drift. This value is given by 
the maximal difference between the expected exit time from [0, 1] of a Brownian motion starting 
at x with a constant drift fx or —fx. Namely, for v E K., set a u = inf{t ^ : Bt + vt ^ ]0, 1[ } 
and f u (x) = E, x (a u ). Then, by taking the derivative at of the moment-generating function of 
a Brownian motion with drift (see [TJ II.2.3]), we find, after tedious calculations, that 

T 1 _ p -2ux 

and that 

c*( M ) := max (f»(x) - f^(x)) 
xe[o,i] 

■1 
/' 




^aog(^(l- A /l-^fc)) +A /l-^fe^ (2.2) 



for any ^ G K + (note that lim^o c *(/ i ) = an d lim^+oo c*(/i) = 0). This maximum is attained 
at 

^M^W 1 -^))^)- (2 - 3) 

The third property concerns the general shape of the optimal strategy. Indeed, consider 
two scenarios in the minimization problem. Assume first that one starts near 1 with a positive 
drift. The player will keep this favorable drift for a while. If the particle goes down, then when 
it reaches ^, both drifts are equivalent because of the symmetry property. Since the player is 
subject to a switching penalty, he will keep the positive drift. If the particle keeps going down, 
then it will become more advantageous to change to a negative drift so that the particle will 
exit more quickly through 0. 

Secondly, if one starts close to with a positive drift, then the diffusive behavior of the par- 
ticle makes it very likely that it will rapidly hit even if the drift is in the unfavorable direction. 
Thus, it is probably not worthwhile to pay the penalty to change the drift. These two facts are 
summarized by the following property: 



Property 3. There exist two barriers a c and b c satisfying < a c ^ b c < ^ and such that it 
is optimal to keep a positive drift above b c or below a c and it is optimal to switch to a negative 
drift within [a c ,b c ]. 

In the case of the maximization problem, this property becomes: 

Property 3 max . There exist two barriers a™ ax and b™ ax satisfying \ < a™ ax ^ b™ ax < 1 and 
such that it is optimal to keep a positive drift above b™ ax or below a™ ax and it is optimal to switch 
to a negative drift within [a™ ax , b™ ax ] . 



2.2 Solution of the minimization problem 

The solution of the stochastic control problem (jl.4p is found through the resolution of a free 
boundary problem for the value function. In the region where it is optimal to keep the current 
drift, the value function must satisfy a certain ordinary differential equation: see (|2.4ap . In the 
region where it is optimal to switch to the other drift, we have another equation: see (|2.4bj) . 
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These equations are obtained by the dynamic programming principle and the Hamilton-Jacobi- 
Bellman equation (see e.g. [101 Section 3.1] or [191 Section 3]). Following this principle and the 
three properties that we assumed, we expect that the value function should satisfy the following 
problem, in which V c (x+, a) (resp. V c (x— , a)) denotes lim^ V c (y, a) (resp. lim^ V c (y, a)): 

M ^ (:C ' 1) + ^ (X ' 1) = - 1 ' 
V c (x,l) = V c (x,-l) + c, 

V c (0, 1) = V e (l, 1) = 0, 

V c (a c -,1) = V c (a c +,1), 

V c (b c -,l) = V c (b c +,l), 

^ (ac -' 1) = ^ (ac+ ' 1} ' 

^ (6c -' 1) = ^ (6c+ ' 1} ' 
V c (x,-1) = V c (l-x,l), 

where a c and b c are two unknowns satisfying < a c ^ b c < \. 

Proposition 1. Let c*(//) be given by &2.2\) . There exists a unique solution {V c ,a c ,b c } to the 
free boundary problem \2.1$. 



x G \0,a c \U]b c , 11 




(2.4a) 


x G [a c , b c ] 




(2.4b) 




(boundary conditions) 


(2.4c) 




(continuous fit) 


(2.4d) 




(continuous fit) 


(2.4e) 




(smooth fit) 


(2.4f) 




(smooth fit) 


(2.4g) 


x G [0, 1] 


(symmetry) 


(2.4h) 



1. If c = c*(/i), i/ien i/ie solution is given by 



a , _ V _ i- (, og ^ ^ _ ^ _ _g_JJ + „J (2 . 5) 
and 

y c »(x,a) = r^(x) = J c «(x,a,i), s€[0,l], o€{±l}, (2.6) 

where A = {At = a)t>o * s ^ e constant strategy and f a ^ is defined by A2.1\) . Moreover, 

a c * =argmax{r(x)-/-^(x)} and f^{a c *) = f~^{a c *) + c*(n). (2.7) 
xe[o,i] 

If < c < c*{jj), then the solution is given by 

' -^ + /3 c (e- 2 ^'-l), xe [0,a c [, 
^,1)= ^"c^-lj+c, x€[a c ,6 c ], (2. 8 ) 
1=2 + ac (>(1-*) _ l), xG]6 c ,l], 

V c (x,-1) = V c (l-x,l), x€[0,l], 

where b c G [0, \ [ is i/te unique solution x of the transcendental equation 

e 4nx-2n( 2fJiX - H + op 2 - 1) + 2(ix - n + cp? + 1 = 0, (2.9) 

ac = o 2 r^TT V' ( 2 - 10 ) 

a c is the unique solution y G]0, b c [ of the transcendental equation 

fi 2 a c e^ y + (1 - 2fi 2 a c )e 2m - 2/j,y + fi 2 a c - cfi 2 - 1 = (2.11) 

and 

(3 c = -a c e 4 ^- , 



p c = -a c e 4fiac - e 2 ^ ac . (2.12) 
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We now use the value of the barriers a c and b c to define the following four subsets of [0, 1]: 



d = [0,ac[U]6 c ,l], C_i = [0,l-6 c [U]l-o c ,l], 

Di = [a c ,b c ], D_! = [1 - b c , 1 - a c ]. 

The subsets C a and D a are called respectively the continuation and the switching region for 
the drift a. For < c ^ c*, we define the candidate optimal strategy A c as follows. Let 
(x,a) £ [0,1] x { — 1,1} be the initial conditions, define inductively an increasing sequence 
(r n ) ne N of stopping times by tq = and for n ^ 0, 



Tn+l 



inf{^r n :Xf €£»(_!)„«}, if {•••}/ 
+oo, otherwise, 



where X 1 = x, and for n 0, X™ is the process defined as the solution of 

dX? = {-l) n a^dt + dBt, t £ [r n , +oo[ , 

x n =X n-l m 

1 n 1 n 

Set r = inf {i > : 3n ^ with X t n £]0, 1[ and t € [r n ,r n+ i[}. Then define A%_ = a, A c t = a 
for t G [ro , Ti [ , and for n ^ 1 , 

A t c = -A£ n _, for t e [r n , r n+ i[ . (2.13) 
This construction implies that A° satisfies for all t ^ 



A '=i-it, if^-^r. <2 - i4) 

and the controlled process X AC is the solution of dX A ° = A^fidt + dBt and X A " = x. Observe 
that the sequence of the stopping times (r n ) corresponds to the jump times of the strategy A c , 
that X A ° = X™ on [r n , r n+ i[ and that r = t ac , the exit time from ]0, 1[ of X A " . This candidate 
strategy is pictured in Figure [J and it satisfies the following properties. 

Proposition 2. If < c ^ c*(fi), then for all x £ [0, 1] and a E { — 1, 1}, we have 

®x,a {t AC ) < +oo and E Xj a (N t ac (A c )) < +oo. 

Now that we have exhibited a candidate strategy and a candidate value function as the 
solution of a free boundary problem, we can state the optimality theorem. 

Theorem 3. Let c*(fi) be given by $2. 6 2\) . If A c is the control satisfying \2.13\) (and {2.1$ ) and 
ifV c denotes the unique solution of the free boundary problem \2.J$ given in Proposition^ then: 

1. for < c ^ c*(/u), the value function is V c = V c and A c is an optimal control for the 
problem \1.4\ ); 

2. for c > c*(/x), the value function is V c = V c *u\ and A = (A t = a)t>o ^ s ^x,a- a - s - the unique 
optimal control for the problem 

Remark 4. In the case where c = c*(/i), we see in Proposition [1] that the switching regions 
consist of one single point, at which a change of drift can be considered as insignificant. Indeed 
at this point, the price to pay for a change of drift is equal to the maximum expected profit 
provided by this change itself. Moreover, the same Proposition together with Theorem [3] show 
that the constant strategy and the candidate A c are both optimal in this case. The same 
remark will apply to the maximization problem. For a uniqueness result when < c < c*(/i), 
see Proposition [T71 
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2.3 Solution of the maximization problem 

As for the minimization problem, we formulate a free boundary problem for the value function 
that is motivated by our assumptions on the solution and by the dynamic programming principle: 



M J^L-(x,l) + -_2^_(x,l) = -1, x G [0,ar x [U]6rM] (2.15a) 

V c max (x, 1) = F c max (x, -1) - c, x G [a™ ax , C ax ] (2.15b) 

y c max (0, 1) = y c max (l, 1) = 0, (boundary conditions) (2.15c) 

y max( a max_ ^ = y ma x ^max +; ^ (continuous fit) (2.15d) 

y max( 6 max_ ; y = ymax^max +; ^ (continuous fit) (2.15e) 

i^_( a ™x_ 1) = ^—( a ™ x +, 1), (smooth fit) (2.15f) 

aymax Qymax 
^ v c /imax - ^ uv r 



^ (r x - l) = ^(r x +.l). (smooth fit) (2.15g) 

y c max (x, -1) = V c max (l - x, 1), x G [0, 1] (symmetry) (2.15h) 

where a™ ax and 6™ ax are two unknowns satisfying \ < a™ ax ^ 6™ ax < 1. Even though the 
solution of the free boundary problem in the maximization problem is similar to the one in 
the minimization problem, the two problems are not symmetric as we shall see in the next 
proposition. 

Proposition 5. Let c*(p) be given by 12.2]) . There exists a unique solution {V™ ax , a™ ax , b™ ax } 
to the free boundary problem \2.15\) . 

1. If c= c*(fi), then the solution is given by a™ ax = b™ ax = 1 — a c and 

V c T ax (x,a) = V c *(x,a) = f a »(x), x G [0, 1], a G {±1}, (2.16) 

where a c and V c * are given by Proposition^ and f aiM is defined by 112.1]) . 

2. If < c < c*(/i), then the solution is given by 

-fl+7c(e- 2flx -l), x6[0,aH, 
-— + 7c (e -2 ^ 1- ^ - l) - c, x G [a™ ax ,b™ ax ], ( 2 .17) 



V c max (x, 1) = { 



1=2 + S c ( e Mi-*) - 1 ) , x£]b™ ax ,l], 



V c max (x, -1) = V c max (l - x, 1), x G [0, 1], 

where a™ ax = 1 — b c and "y c = a c e 2 ^ with b c and a c given by Proposition [TJ b™ ax is the 
unique solution x G ]a™ ax , 1[ of the transcendental equation 

Tc/xV^- 4 " + e 2 ^- 2 ^ (1 - 2 lci ?) - 2fix + 2fi - 1 + 7c /i 2 + c/i 2 = (2.18) 

and 

5c = e -2M(i-fe— ) _ 7c6 -4Mi-^). (2.19) 

Moreover, b™ ax > 1 — a c . 
We construct the candidate strategy for the maximization problem as we did to get to (|2.14p . 



Let 



C x max = [0, ar x [ U ] C ax > 1] , C-f x = [0, 1 - 6T [ u ] 1 " a™ > 1 j > 

^max = ^max ^maxj ^ ^max = ^ _ ^max^ j _ a max] 
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Figure 1: Illustration of the control A c on the left-hand side and of G c on the right-hand side 
in the case where < c < c*(/x). Here we assume that the initial drift is positive. 

with a™ 3 * and b™ 3 * given in Proposition [5j We denote by G c the strategy constructed using the 
ideas that led to (|2.13p and that satisfies 



j G c t _, if Xf G C^ c a _ x , 
G c t = { Gf _ ifX? c £Dr x (2 - 20) 



where X G ° is the process controlled by G c . This strategy is pictured in Figure [T] and it satisfies 
the following properties. 

Proposition 6. If < c ^ c*(p,), then for all x G [0, 1] and a G { — 1, 1}, we have 
E x , a (r GC ) < +oo and E X;0i (N t g- (G c )) < +oo. 



Theorem 7. Let c*{(j) be given by \2.2\) . If G c is the control satisfying \2. 20\) and if V c 
denotes the unique solution of the free boundary problem Ii2.15\) given in Proposition then: 



max 
c 



1. for < c ^ c*(p), the value function is V™ ax = y^ ax an d Q c { s an optimal control for the 
problem il.5\) : 

2. for c > c*(/i), the value function is VJ aax = V^a, and A = (A t = a) t ^o is F Xja -a.s. the 
unique optimal control for the problem il.5\) . 



3 Proofs 

3.1 Free boundary problem for the minimization problem 

The general solution to the o.d.e. (|2.4a|) is v(x) = — — + c\e~ 2 ^ x + C2 where c\ and C2 are 
arbitrary constants. Since (|2.4ap is satisfied on the two disjoint intervals [0,a c [ and ]6 C ,1], this 
yields four arbitrary constants to determine. The boundary conditions ()2.4c[) reduce this to two 
unknown constants (see [181 Ch.2] for details). The value of V c (x, 1) for x G [a c ,6 c ] is obtained 
by using (|2.4bp together with (|2.4hp . We then find that V c must satisfy 



V c (x, 1) 



-2pLX 



1-x 



+ Oi c 



2^x 



1) 
1)+C 



,2^(1-*) 



x € [0,a c [, 
x G [a c ,b c ], 

x G]6 C , 1], 



(3.1) 
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where a c ,[3 c , a c and b c are four unknowns that we have to determine using the equations (|2.4dj) - 
( 2.4g[ ). They give us after some simplifications, in the same order: 



+ p c ( e -2^ c _ i) = Qc ( e 2^ c _ 1) + Cj (3.2) 

ac (e>»»c _ i) + c = l^k + ac (>(l-&c) _ ^ ; (3 . 3) 

2/ia c e 2 ^ ac + 2/3 c /ie- 2 ^ ac + § = 0, (3.4) 

2fia c (e 2 ^ + e^ (1 - 6c) ) + § = 0. (3.5) 

Multiply (1321) by e 2 ^ ac , O by e 2 ^ , ([31} by 4 e 2 ^ and ([33]) by ^e 2 ^ c , to obtain, after 
simplifications, respectively the four equations 

a c e 4 ^ + (/3 C - a c + ^ + c) e 2 ^ c - & = 0, (3.6) 

a c e 4 ^ + ^ + /3 c = 0, (3.8) 



a c e 4 ^ + ^+a c e^ = 0. (3.9) 

Subtract ()3.7p from (j3.9fl . and solve this equation for a c , then insert this expression into the sum 
of (|3.7p and (|3.9p . to get a new equation (|3.10p for b c . Solve (|3.8p for (3 C , and plug this value 
into (|3.6|) to get a new equation (|3.1ip for a c . These equations are 

e M^ c -i)^ 2bc _ ^ + c ^2 _ ^ + ^ 2bc _ ^ + Cfi 2 + x = Qj ^ 310 ^ 

^ 2 a c e 4Atctc + (1 - 2^ 2 a c )e 2/Mc - 2fia c + /i 2 a c - c/z 2 - 1 = 0, (3.11) 
and the formulas for a c and j3 c are 

Equations ()3.10p for b c and f)3.11j) for a c are transcendental. We define 

h c (t) = e 2t (t + c[i 2 - 1) + t + cfi 2 + 1, (3.12) 
h c (s) = fi 2 a c e 2s + (1 - 2/i 2 a c )e s -s + [i 2 a c - c[i 2 - 1, (3.13) 

so that b c and a c are respectively solution of /i c ( / u(26 c — 1)) = and h c (2fia c ) = 0. Setting 
i c = /i(26 c — 1) and s c = 2/ia c , we find that solving the system (|3.2p - (|3.5p with < a c ^ b c < ^ 
is equivalent to solving 

h c (t c ) = 0, (3.14) 

hc(sc) = 0, (3.15) 

a c = (t c + cf/-l)^e t ^, (3.16) 

/3 c = -a c e 2Sc -^e Sc , (3.17) 

with — fj, < t c < and < s c ^ t c + ^. 

Remark 8. By computing two derivatives, we see that h"(t) > 0, for all t € R, lim^-oo h' c (t) = 
1, therefore h' c {t) > 0, for all t £ R, therefore h c is strictly increasing with h c (—cfj? — 1) = 
_ 2e -2(c M 2 +i) < q and /j c (_ CjU 2^ = _ e -2c^ 2 + i > o, so that (|3.14p admits a unique solution 

i c G ] — cy? — 1, — cfj, 2 [. On the other hand, h c (0) = —cfi 2 < and we see by direct calculation 
that h' c (s) = if and only if s G jo, log (27^;) }• We set 

*""- k *(??b) < 3J8 > 
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and depending on the sign of this value and of h c (m c ), (|3. 15[) has up to three solutions. This 
will be discussed later on a case by case basis. 

Proof of Proposition [IJ Let us start with the case where c = c* := c*{fj). In this case, the unique 
solution of (|3.14|) is given by 



-cV-a/ 1 



sinh (/Lt) ' 



(3.19) 



Indeed, by (|2.2p . (|3.19p and direct computations, 



h c *(t c *) = e Mc * (t c * + cV - 1) + tc* + c*fi z + 1 

2 



sinh(/j) 



1- a/1 



sinh' 1 (fj,) 



sinh 2 (fi) 



1 - a/1 



H- I 1 

sinh 2 (/it) 



0. 



Using the formula for c* in (j2.2jl . we can write 



log 



sinh(/x) 



1 



1 



sinh 2 (fi) 



(3.20) 



Moreover, > t c * > — /i. Indeed, the first inequality follows from the fact that sinh/i > \x and 
the second one is equivalent to smh ^ I 1 



y y 1 — sinh a hiS ) > e ^ which, in turn, is equivalent 
to e 2At (/x — l) + ^ + l>0; this last inequality is satisfied for all \i > 0. Plugging into (|3.16|) the 
value of t c * given by ()3.19p . or by (|3,20p when it appears in an exponential, we obtain 



(3.21) 



2/x sinh(^) 

We now observe that the unique solution s c * of (|3. 15[) such that < s c * ^ t c * + /x is given by 

Sc * = t c * + \i. (3.22) 

Indeed, by definition of t c * (see (|3.19p or (|3.20p ) and of a c * in (|3.2ip . we have 

h c *(t c * +n) = /i 2 a c *e 2( * c * +M) + (1 - 2/i 2 a c .)e* c * +At - (t c * + n) + /i 2 a c » - c> 2 - 1 
' ( e *c*+M _ !) 2 + e * c .+M _ ( ttf , + C * M 2) _ ^ _ i 

oA j / sinh(^) ( 



— ^ 
2 sinh(/j) 

0. 



1 



sinh {f£) 



1 



sinh(/i) 



1 



1 



sinh (/i) 



+ A 1 



sinh 2 (/i) 



The uniqueness on the interval ]0, t c * + fj] is obtained by considering the position of the extrema 
of h c *. Indeed, setting 



log 



1 



2{j, 2 a c * 



log ( e 



sinh(^i) 



fj, + log 



sinh(/i) 



and since sinh(//)//i > 1 for all \x > 0, we have that m c * > [x > t c * + fi > 0. Thus, the function 
h c *(s) vanishes three times: the first time on the interval ] — oo,0[, then it reaches at a local 
minimum h c *(0) = —c*/j, 2 , then it increases, vanishes at t c * +/x < rh c * and keeps increasing until 
rh c * where it reaches a local maximum. Therefore h*(rh c *) > 0. Finally, h c *(s) vanishes a third 
time on the interval ]rh c *, +oo[. 
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It remains to determine the parameter /3 C * which, by (|3.17p . (|3.22p . (|3.20p and (|3.2ip . is given 

by 

2/i sinh(/i) ' 

We have therefore solved the system ()3.14p - (|3.17p and we have found that 



Pc* - 2usinWuV ( 3 ' 23 ) 



6 - = K^ + 1 ) 6]0 ' M and a "' s i = t ^r = h '" <3 - 24) 

with t c * given by (|3.19p . This establishes the existence and uniqueness of the solution V c * of the 
free boundary problem (|2.4p . This solution is given by 

12 _l r_, f„-2F 



_ / ^+/3 c *(e~ 2 ^-l), xe[0,a,], 
If- + a* (e^ 1 -) - l) , ,£[«,,!], 



-X 



, — + ^i=iS) ■ s€ [0,a c .], 

/"(a) = (a") , x€[0,l], 



(3.25) 



and V c *(x,—1) = V c *(l — x, 1) = / M (x). By definition of ^4, we have f afJ- = J c *(x,a,A) where 
A is the constant strategy (A t = a). Finally we find using (|3.24|) and (|3.20p that 



,2 



which, according to (|2.3p . is the location of the global maximum of f^(x) — f~ fl (x) on the interval 
[0, 1]. Therefore, by definition of c*(/u), we have f^{a c *) = f~^ l (a c *) + c*(/i), and this completes 
the proof of the first part of Proposition [TJ 

Let us now consider < c < c*(fi). The form of the solution V c of the free boundary 
problem (|2.4|) given in (|2.8|) has already been discussed starting with (|3.ip and reduced to the 
resolution of the equivalent system ()3.14p - (|3.17p with —fj, < t c < and < s c < t c + fj,. 

We start by showing that the unique solution t c of (|3.14|) mentioned in Remark [S] is such that 
— /i < i c * < t c < —cfi 2 . The first inequality is mentioned just after (|3.20p and the last inequality, 
as well as the uniqueness of the solution, has been discussed in Remark Observe that by 
definition, t \— > h c (t) and c i— > h c (t) are both strictly increasing. Thus, h c (t c *) < h c *{t c *) = and 
since, by definition, h c (t c ) = 0, we obtain the last inequality t c * < t c and this establishes (j2.9[) 
of Proposition [TJ 

We now establish (|2.10p . Notice that by definition of t c , we have e 2tc (t c + c[i 2 — 1) + t c + 
cfi 2 + 1 = 0, which is equivalent to 

9 -l + e 2tc sinh(i c ) 
1 + e Mc cosh(t c ) 

and which yields (12TTTJD . Indeed, by (|TTSj) . 

a c = (t c + cfj, 2 - e**-" = ^ 2 cogh(tc) = 2fi2 cosh(2/i6c _ m) • (3-27) 

In order to prove (|2.1ip or, equivalently, to show that there exists a unique solution s c 
of (|3.15p such that < s c < t c + fi, we need to study the function h c and more particularly the 
position of its local maximum h c (rh c ) (see Remark [8]). Observe that by (|3.18p and (|3.27p . 



rh c = log ( — -J — ) = f-i + log (cosh(t c )) > fi. 

Zfl OL c 
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As t c < 0, we have 

< 2fxb c = t c + fi< m c . (3.28) 
Plugging s = 2fib c = t c + fi into (|3.13p . we see that 

h c {tc + n) = H 2 a c {e^ - l) 2 + - (t c + cfi 2 ) - M - 1. 

Since fi 2 a c = — e t c e + ^- tc by ()2.10p . and expressing t c + cfi 2 using (|3.26|) . we obtain 

h c (t c + ,j) = ~ e \ \ (e^+v - l) 2 - e tc+2 v (e tc + e" tc ) + e tc+ " - 

gt c _J_ g t c V / V / 



and this simplifies to 



Define 



r , > sinh(u) 

h c (t c + v) = -v+—^- 3.29 
cosh(t c ) 

, / \ sinh(u) 
cosh(i) 



Clearly, this function has two zeros t < and —t > 0. From (|3.29p . k(t c *) = h c *(t c * + fi) = 
by (|3.22p . Therefore, i = t c * and, since t c * < t c < 0, we conclude that k(t c ) > 0, which implies 
that 

h c (2fib c ) = h c (t c + n) = k(t c ) > 0. (3.30) 

Since h c is monotone on [0, m c ] and h c (0) = —c[i 2 < 0, we conclude that < s c < t c + fx, which 
establishes (|2.11|) . Finally, (|2.12|) is simply a rewriting of (|3.17p . □ 

3.2 Proof of optimality for the minimization problem 

We now aim to prove that the solution V c of (j2.4|) given in Proposition [JJ is indeed the value 
function. For this, we could apply the Verification Theorem 6.2 of [10J. However, we prefer 
to give a direct proof, in which the main steps correspond to checking assumptions of the 
Verification Theorem. Indeed, Lemma [9] below corresponds to verifying hypotheses (vi) and (x) 
of \10\ Theorem 6.2], and Corollary 1111 below corresponds to hypothesis (ii) there. However, 
by detailing the proof, we can identify where any deviation from the strategy A c leads to a 
suboptimal cost function, and this will be useful in our result on uniqueness (Proposition [T7] in 
Section SJ). 

Before proving Proposition [2J we introduce some notations. Let (r n ) be the sequence of 
switching times of A c and let t ac be the exit time of X A " from [0,1]. For a Brownian motion B 
starting a.s. at x and for a < x < b, let 

pt(a, b) = F x {B t ± fit hits a before b} . (3.31) 

These quantities satisfy the translation invariance property p%(a, b) = p^ +h {a + h,b + h) for all 
and the symmetry property p~ (a, b) = p_ x (—a, —b). We also define 

o^ b = M{t^0:B t ±/jLt^]a,b[}, 
E x (y,a,b)=E(a+ b B a+ + /z<x+, = y, B = x) , y£{a,b}. (3.32) 



These expectations and probabilities can all be explicitly computed (see e.g. [U II.2.3]). In 
particular, the expectations are finite and < p^(a, b) < 1. 
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Proof of Proposition^ Using the above notations, we find that for all k £ N, 

F x , a (N t ac(A c ) = k) =¥ Xta (r k < t ac < T k+ i) 

= Px,a {T AC < Tfc +1 | Tfc < T AC ) P x , a [r k < T A ° \ T k _ X < T A °) 

(r 2 < r AC | n < r AC ) F x , a (tl < t ac ) 



X • • • X 



x,a 



since {tj < t a °} D {r j+1 < t a °} for all j > 1. 
If x £ {0,1}, thenE 

x,a y ) — lEj.^ (N t a c (^4 C )) — 0. Consider now the case where x £ ]b c , 1[ 
and Aq_ = a = 1. Notice that for all k ^ 1, on {r^ < t ac }, X a ^ = b c if k is odd and X A ^ = l — b c 
if is even. Clearly, ¥ Xj i (tl < r^) = p£(b c , 1) and since the process X AC is strong Markov by 
construction, for k even (but also, by symmetry, for k odd), 

fa+l < ^ I < T AC ) = P!_ bcil (TL < T AC ) = P+_, c (fe c , 1). 

Therefore, 

f 1 if A; = 0, 

{ Px( b cA){Pi- bc (b c ,l)) (1-Pi_6 c (bc,l)), iffc^l, 

that is, given iV T A= (^4 C ) ^ 1, A^ t a= (j4 c ) is a geometric r.v. with parameter 1 — Pi_ b (b c , 1) £ ]0, 1[ . 
Therefore, E Xj i (N t a c (A c )) < +oo, and this establishes the second statement in Proposition [2j 
Turning to the other statement, by the law of total probability, 

+oo 

E M { tA 1 = E E ^ ( TAC I Tk < ^ < Tfc +! ) P *.l ^ (^) = *0 • ( 3 - 34 ) 
fc=0 

For fc = 0, 

(r AC |0<r AC <n) =^(1,6 C ,1). 
For k^l, on {T fc < t a " < r k+1 }, 

T A ° = TL + (T 2 - Tl) + • • • + (Tfc - Tjfc-l) + (r AC - T k ). 

By the strong Markov property, 

E^i (tj, I T fc < t ac < r fc+ i) = E^i fri n = ^t a ,l) = E xQ>c, b c , 1), 
and for 2 < £ k, 

E X) i (rjg - r^_i | r fc < t ac < Tfc+i ) = Ei_ bc (b c , b c , 1) 

and 

- Tfc j Tfc < T A ° < Tfc+i ) = E^ bc (1 , 6 C , 1) . 

Therefore, for k ^ 1, 

E*,i (r AC | ^ < t ac < Tfc +1 ) = E x (b c ,b c , l) + (k- 1)^.^(60, 6 C , 1) + ^i_ 6c (l,6 c , 1), 

and we conclude from (|3.33|) and (|3.34|) that E^i (r AC ) < +00. 

The cases x £ [0, o c [ , x £ [a c ,b c ] and a = — 1 are treated similarly. This completes the proof 
of Proposition [2l □ 
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Lemma 9. Let L a denote the infinitesimal generator of a Brownian motion with drift a/i, 
a G {±1}; that is, for f G C 2 ([0, 1],M) 

df ld 2 f 

h a f(x) = afi—(x) + --^(x). (3.35) 

Then, for all < c < c* (//) , 

1 + h a V c (x, a) = 0, for all x G C a , (3.36) 

1 + L t^(s, a) > 0, /or a// i£D„\ dD a . (3.37) 

Moreover, ifc = c*(fi), then 

1 +L a F c *(x,a) = 0, /or a// x G [0,1]. (3.38) 



Proof. In the case where c = c*(/i), (|3.38[) is a standard property of V c * (x, a) = / aAt (x) (see (|2.6p ). 
but it is also easily obtained from the explicit expression that we have for f a ^ (see (|2.ip ). 

Assume < c < c* and consider the case where a = 1, since the other case is similar. The 
function V c (x,l) is C 2 in both C\ and D\ \ dD\. The first equality (|3.36|) follows from the 
construction of V c (see f|2.4a|) ). It remains to prove (|3.37p . By construction (see (|2.4bp ). for all 
x G D\ \ dD\ = ]a c , b c [, we have V c (x, 1) = c + V c (x, —1) and thus, 

dV 1 d 2 V 

1 + UV c (x, 1) = 1 + Li(c + V c (x, -1)) = 1 + n — -(x, -1) + -—^(x, -1). 

ox I ox z 

Moreover, since ]a c ,6 c [ belongs to C_i in which (|3.36p is satisfied, we have 

dV 1 d 2 V - dV 

l+U%(x,l) = l + Ai -^( x ,-i) + --^( Xl -l)-(l+L_iV r c (x,-l))=2/i-^(x,-l). (3.39) 

Thus, we have to prove that fi^-(x,—l) > for all x G D\ \ dD\. If x G]a c , b c [, then 
1 — x G ]1 — b c , 1 — a c [ C ]o c , 1] and according to (|2.8p . 

K(x, -1) = K(l - x, 1) = £ + a c (e 2 ^ - l) . 

Therefore, /i^(x,-l) = 1 + 2/i 2 a c e 2/ " : for all x G]a c ,6 c [. As x G ]a c , & c [ C ]0, §[ and a c < 0, 
we get according to (|3.27p that 

1 + 2fi 2 a c e 2fix > 1 + 2/i 2 a c e" = 1 — \ > 0, 

cosn(2/io c — n) 

which establishes the lemma. □ 
Lemma 10. For all < c ^ c*(/x) and any a G {—1, 1} ; if x G C a; i/ien 

t4(x, a) < c + t4(x, —a). 



Proof. In the case where c = c* (//) , the result follows immediately from (|2,7p together with ()2.6p . 
Assume < c < c*(/i) and consider the case where a = 1, since the other case is similar. We 
distinguish four cases. 

Case 1. If x G [0, a c [ , then 1 — x G ]1 — a c , 1] C ]6 C , 1] and, according to (|2.4hp and (|2.8p . 

c + V c (x, -1) - y c (x, 1) = c + f + a c (e 2 ^ - l) - & (e" 2 ^' - l) =: di(x). 

We will show that d\(x) > for x G [0, a c {. Indeed, d'i(x) vanishes at most twice on R, because 
the equation (^(x) = is a quadratic equation in e 2 ^ x . The roots of (^(x) are given by 
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with Ai = jjt^z ~ By ([27T21) and OTTOl) . we have 



/ 2/ia c -/i \ z 

1 - 4/x 4 a c /3 c = (1 + 2^ 2 a c e 2 ^) 2 =1 — — > 

' \ cosh(2/io c — (j,) J 

and thus Ai > 0. Using (|2. 12|) . (|2.10p and the fact that a c < b c , we see that f3 c < 0, and so 
(— 2/xa c ) _1 — \/Ai > 0. Therefore, xf G R. From the formula for e^(x) and (|2.12p . we see that 

/ p 2/j,a c \ 

di(a c ) = 2 + 2 l *a c e 2tu ° + 2^ c e- 2fia " = ^ + 2^ia c e 2 ^ - 2fi a c e 4/Mc + — =- e" 2 ^ = 0. 
Therefore, o c G {x^,x+}. By ([33BD . 

< 2jia c < 2jib c < rh c = log 



2/i 2 a 



Since 2/ixJj" < rh c < 2fixf , we find that xj~ = a c < xf. This implies that the function d\ is 
monotone decreasing on ] — oo,a c [ with di(0) = c > and d\(a c ) = by (|2.4bj) . The function 
d\ is thus strictly positive on [0, a c [, which proves the desired inequality. 

Case 2. If x G ]b c , 1 — b c [ , then 1 — x G ]b c , 1 — b c [ and according to (|2.4hp and f|2.8|) . we have 

c + F c (x, -1) - F c (x, 1) = c + *EpI + a c (e 2 ^ - e^e" 2 "*) =: d 2 (x). (3.41) 

We will show that d 2 (x) > for x G]6 C , 1 — b c [. Indeed, its derivative d 2 vanishes at most twice 
on R, at 



1 , / 1 



2/j, \ 2[i z a c 

where A 2 = - e 2 ^. By (\2.W\). we find that -2fi 2 a c = cosh(2 ~fc e , M) < since b c < \. 

Hence, A 2 > 0, and according to ()2.4bp and condition ( |2.4g| ) , we have that d' 2 (b c ) = 0. Moreover, 
we notice that d' 2 (l — b c ) = d 2 (b c ) = 0. Thus, x 2 = b c < x 2 = 1 — b c and the function d 2 is 
monotone increasing on ]b c , 1 — b c [. From (|2.4bj) . we have that d 2 (6 c ) = 0, thus, the function <i 2 
is strictly positive on ]b c , 1 — b c [ , which proves the desired inequality. 

Case 3. If x G [1 — b c , 1 - a c ], then 1 - x G [a c , b c ] = D 1 and by (|2.4hp and (|2.4bp . 

c + V c (x, -1) - V c (x, 1) = c + V c (l - x, -1) + c - V c (x, 1) = 2c> 0, (3.42) 

which proves the desired inequality. 

Case ^. If x G ]1 — a c , 1], then 1 — x G [0, a c [ and we have, according to (|2.4hp and (|2,8p . 

c + K(x, -1) - ? c (x, 1) = c - 2 X —^- + & ( e - 2 A*(i-«) - l) - Qc (e 2 ^ 1 "*) - l) =: d 3 (x). 

We see that e?3(x) = 2c— di(l — x). Thus, d% is monotone on ]1 — a c , 1] and since 03(1 — a c ) = 
2c — di(a c ) = 2c and ds(l) = 2c — di(0) = c, the function ^3 is strictly positive on this interval. 
This proves the desired inequality in this last case. □ 

Let us define H c : R + x [0, 1] x {-1, 1} x N — > R+ by 

(t, x, a, n) 1 y H c (t, x, a, n) := i + cn + P^(x, a). (3.43) 

For ^4 G A, we consider the process H%' = H c (t, Xf,Af, N t (A)), where N t (A) is given by (|1.2p . 
and we write Aii^'" 4 = -f^'" 4 — H c s '\ Observe that Hq A = V c (x, a), P^-almost surely. 
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Corollary 11. Let < c ^ c*(/i), let A c denote the control satisfying \2.1J$ and let A £ A be 
any admissible control. Then, for all x G [0,1] and a G { — 1,1}, ¥ x>a -a.s., for all s G M + : (1) 
AH C S ' AC = 0; (2) AH C S ' A ^ 0; and (3) AH C S ' A > if and only if Xf G C As . and A s / A s _. 

Proof. Let A G A and let s G M+. If s is a time of continuity of the strategy A, then clearly 
AHs ,A = 0. Assume s is such that A s „ / Aj. Then AiV s (,4) = 1 and 

AH^ A = c + V c (X A ,-A s „) - V C (X A ,A S _). 

If Xf G £>a s _, then AF s c,j4 = by construction of V c (see IjOEjl). If X A G C As _, then 
Ai^s'" 4 > by Lemma [lUJ For the control A c satisfying (|2.14|) . A c s _ ^ A c s if and only if 
Xf G Da c s _ , and this completes the proof. □ 

We can now prove the following proposition. 

Proposition 12. Let A c denote the candidate strategy satisfying \2.tJ$ , let H c be defined 
by {3.4ty and let c*(/x) be given by \2.2\) . IfO < c < c*(p), then for all x G [0, 1] and a G {-1, 1}: 

1. the process {H^' AC )t^o is a martingale under ¥ x ^ a ; 

2. for any A G A, the process (H^ A )t^o *s a submartingale under ¥ x ^ a . 

In order to prove this, we first define an extension of V c . Since this function is defined from 
[0, 1] x {-1, 1} into R, we let 

y c(x , y) = y^)-n^) y+ %(^) + v^-i) t y6hlil]i (3 . 44) 

denote its linear interpolation on [0, 1] x [—1, 1], so that V c (x,y) becomes a C°°-function in the 
variable y G [—1, 1]. Furthermore, we let T> = {a c , b c , 1 — a c , 1 — b c } be the set of discontinuities 
of y) in the variable x when < c < c*. 

Proof of Proposition \12\ Using the extension of V c , we see that H c (t,x,y,n) is C°° in the vari- 
ables t, y and n, in the variable x, it is C 1 on [0, 1] and C°° on [0, 1] \ T>. Applying Ito's Formula 
for processes with jumps (see e.g. |15|. p. 81]) and a local time-space formula for the variable x 
(see [TH Theorem 3.2]), we get for all t ^ 0, 

ftAT A ftAT A OT> fthT A QT> 

Hfa = H- A + j o 1 . * + jf °£{xt A s ) dX A + j o ^(X A A s _) dA s 

ft/\r A -i i-tl\r A rpy 

+ J cdN s (A) + -J —£(x A ,A s )l {X A m (s)ds 

+ iir\^ {xf+ ' As - ) ~^ (xf ~' As - ) ) ^^^^ 

+ Yl ( AH s A - ^ S (A) ~ ^(X A ,A S ^)AA S \ , (3.45) 

where ^(X A ) is the local time in T> of the process X A . By the smooth fit conditions, we have 
^-(x+,a) — ^-(x—,a) = for all x G [0, 1] and for all a G { — 1, 1}- Thus, the integral with 
respect to the local time vanishes. If A stands for the Lebesgue measure, then with probability 
1, 

1{X A £V} = 1) for A — almost all s G M+, 

because X A is a diffusion and P is a finite set. Moreover, the semimartingales (A^(^4)) and (At) 
are piecewise constant, so (|3.45p reduces to 

ptAr A rtAr A afr 

H c t > A A =H c > A + (l + h As V c (Xf,A s ))ds+ -^ {X A ,A s )dB s + £ AH^ A 
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where L a is the operator defined in (|3.35j) (if we need a value for ^f(x,a) for x G V, we 
arbitrarily take the second right derivative). 

On one hand, if A = A c , then by Corollary [TT1 AHg' A = for all s ^ 0. Moreover, 
{X S AC G Ci.AS = 1} = {A c s = 1} and {Xf G C-i,^ = -1} = = -1}. Therefore, 

i-tAr AC 

Ktr^ =H° ' AC + / (l + UV c (Xf,l))t {X A^ CuAc _ 1} ds 

J 

rtAr AC rtAr AC fiy 

+ j Q (l + L-iV e (Xf,-l))l {X Ac eC _ ltAB -_ 1} ds + J -^{Xf^dB. 

= H » AC + f* ATA ^(xf,A c s )dB s , 

by Lemma [H Finally, x i— >■ (x, ±1) is bounded on [0, 1], so the stochastic integral above is a 
martingale, which establishes the first statement. 

On the other hand, for an arbitrary control A £ A, we have by the above that for all u < t, 

rtf\T A 

H tt A ~ Ki A = A (1 + La. W, A s )) l { x A eC As} u { x A eD As} ds (3.46) 

[■tl\T A QT> 

+ / ^(^,A s )d5 s + £ Afl?* 



.4 



W -^(X A ,A s )d5 s + ^ (3.47) 

uAt a <s^XAt a 



> f tArA ?Yi {X A As)dBs 

J uAt a dx 



where we used Lemma [9] and Corollary II 11 This shows that H C ' A is a submartingale. □ 

We are now ready to prove the optimality of our candidate strategy. 

Proof of Theorem^ Let < c ^ c*(/x). On one hand, by Corollary 1111 and by the first statement 
of Proposition [121 we have that under IPx a , 

V c (x, a) = H c >f = H C > AC = E x>a (fl££c) 

= E,, a (t A r AC + cN tArA c (A c ) + V c (X^c , A c tArAC )) , 

for all t ^ 0. Since V c is a continuous and bounded function, since N(A C ) is an increasing process 
and since by Proposition [2| Ex, a 

[t a °) < +oo and E^ (N rA c(A c )) < +oo, we get by dominated 

and monotone convergence that 



V c (x, a) = hm E x ^ a (t A t ac + cN tArA . (A c ) + F c (Xf^ , ^ Ar . 4C ) ) 

= E x , a (r AC + cN rA c(A c )), (3.48) 



as X A A C C G {0, 1} and V C (0,±1) = V c (l,±l) = 0. On the other hand, let A G A be such that 
J c (x,a,A) < +oo. Then, by Corollary [TT1 and by the second statement of Proposition [T2l 

V c (x, a) = H C ' A < i? c ^ < E Xta (fl^) ' 
for all t ^ 0. As just above, we get by dominated and monotone convergence that 

KOr, a) < Urn E,, a (fl^) = E x>a (r A + ciV> (A)) . (3.49) 
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If J c (x,a,A) = +00, it is then clear that V c (x,a) < J c (x,a,A). Combining (|3.48p and (|3,49D . 
we obtain 

V c {x,a) = inf E X:a {r A + cN t a(A)) = V c (x,a), 
AeA 

where the infimum is attained by the control A c . This proves the optimality of the strategy A° 
in the case where < c ^ c*(/i). 
Let c*0) < c. Then 

U c .(x,a) = inf E x . a ( T A + c*N t a{A)) < inf E^a (r A + ciV^(A)) = V^s.a), 

by definition of the value function. Moreover, if A denotes the constant strategy, then 

J c * (x, a, A) = J c (x, a, A) = E x>a (r A ), 

and, again by definition of the value function, V c (x,a) ^ J c (x,a, A). Finally, by (|2,6|) and by 
the first part of the proof, we know that V c *(x,a) = V c *(x,a) = J c *(x,a, A). Hence, V c *(x,a) = 
V c (x,a) and the strategy A is optimal for all c ^ c*(/x). 

Suppose now that c > c*(/i) and that there exists another optimal strategy A £ A such that 
there exists (x,a) £ [0, 1] x {-1, 1} with F X)a (N T x(A.) > 0) > 0. Then 

Ez, a (r^ + cN tA (A^J > E x , a (t A + c*N tA (A)^J ^ V c *{x,a) = V c {x,a), 

which contradicts the optimality hypothesis. This shows that if c > c*(/i), then A is the unique 
optimal strategy. □ 



3.3 Free boundary problem for the maximization problem 

The resolution of the free boundary problem (j2.15[) , as well as the proof of the optimality of the 
candidate control, are similar to what we have already done in the minimization problem; we 
will however highlight the places where the computations differ. 

Proof of Proposition^ Let < c < c*(fi). The general the solution to (|2.15ap is the same as 
for (|2.4a|) . and since (|2.15a|) is satisfied in the two intervals [0, a™ ax [ and ]6™ ax ,l], there are 
four constants to determine, which are reduced to two by the boundary conditions (|2. 15c|) . 
Then, (j2.15b|) and (j2.15h|) give the form of U c max (x, 1) given in (|2.17|) . The four unknowns 
5 c ,7 c ,a™ ax and 6™ ax have to be determined using (|2.15d|H[2.15g[ ). Using (|2.17j) . these equations 
give us, after some simplifications, in the same the order: 



+ 7c (e- 2 ^ - 1) = 7c (e-^-S") - l) - c, (3.50) 
7c ( e -Ml-fcr*) _ 1) _ c = 2 -Z*fL + 6c ^Ki-V) _ 1) , (3.51) 

2/i 7 c (e- 2 ^ 1 -™) + e - 2 ^ ax ) +| = 0, (3.52) 
2/x 7c e- 2 ^ 1 -^ ax ) + 2»6 c e 2 ^- b ^ + § = 0. (3.53) 

Observe that setting 7 c e _2M = a c and 1 — a™ ax = b c , the equations (|3.50p and f|3.52[) become 
identical to (|3.3p and (|3.5p . respectively. In the proof of Proposition [Q we have already estab- 
lished that (|3.3p and (|3.5p have a unique solution a c and < b c < \. Thus, it remains only to 
prove the existence of 5 C and 6™ ax solution of (|3.5ip and (|3.53p such that S c satisfies (|2.19p and 
1 - a c < bf ax < 1. 

Equation (|2.19p follows directly from ()3.53p . Substituting (|2.19p into (|3.5ip . multiplying by 
fi 2 and rearranging terms, we get (|2.18p . Now set 

K^{s) = 7c^V 2s + e~ s (1 - 2 7cM 2 ) +s-l + lc[ i 2 + Cf i 2 , (3.54) 
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so that (l2~T8l) is equivalent to /i™ ax (2^(l - 6™ ax )) = 0. Observe that h?**(0) = c/x 2 and, 
by (plU . that 

~ c ( c ^ 2 cosh(2/i6 c — /i) \ cosh(2/i6 c — /j) ) ^ c 

+ C/i 2 



2 cosh(2/i& c — n) 
sinh(2/i& c — li) sinh(/i) 



+ 2/ib c + c/j, 
cusn^/xwc — [i) cusm^/xu c — [X) 

sinh(/x) 



cosh(2/i& c — n) ' 

where we used (|3.26p with t c = 2{ib c — \x to get the last equality. Looking back to (|3.29|) and 
(|3.30p . we see that 

hT^b c ) = p - si °y = -h c {2nb c ) < o. 

cosh(2/io c — /i) 

Furthermore, from (|3.54p . we see that the derivative of /i™ ax vanishes twice: at and at 
log(-27 c ^ 2 ) (compare also with (|515|) ). By (gJDj) , we have that 

log (-2 7c /i 2 ) = log (-2a c e 2 V) = log - M ) ) = M ~ lo s(cosh(2/jfe c - m))- 

Since 2^6 C — /j < because 6 C G [0, ^[ by Proposition [TJ we have that — log(cosh(2/x6 c — /j)) > 
2/j,b c — \i which is equivalent by the preceding to 2/x6 c < log(— 2j c fj?). Therefore, the function 
^max j g mono t one decreasing on ]0, 2fib c [ and vanishes only once on this interval, at a value which 
we denote 2/x(l — 6™ ax ). We have thus established the existence of a number 6™ ax g]1 — b c , 1[ 
which is the unique solution of (|2.18j) . 

Finally, we check that 6™ ax > 1— a c . This is clearly equivalent to showing that 2/j(l — 6™ ax ) < 
2/ia c , where 2/ia c = s c is the unique solution of h c (s) = on ]0,i c + fi[ (see (|3. 15|) ) . We 
have just shown that /i™ ax is strictly decreasing on [0,t c + fj]. The function /i c is strictly 
increasing on [0,t c + fx] (see the end of the proof of Proposition [[J. Thus, in order to prove that 
2/i(l - bf 3 *) < s c , it suffices to show that h c (s) < -hf &yi {s) for all s G]0,i c + We have 

/i c (s) + h™ x {s) = Li 2 a c (e 2s - 2e s + 1 + e 2 ^ + e 2 »e~ 2s - 2e 2 ^e~ s ) + e s + e~ s - 2 
= fj, 2 a c (e s + e~ s - 2){e s + e~ s+2fl ) + e s + e~ s - 2 
= n 2 a c (4sinh 2 (§)) (2e^ cosh(s - p)) + 4sinh 2 (f) , 

which is strictly negative on ]0, t c + fj,[ since by (|2.10p and the fact that — li < t c < 0, 

2u 2 a c e fl cosh(s - u) + 1 = 1 , . , < 0, for all s G 10, t c + a[ . 

cosh(t c ) 

The proof of part 2 of Proposition [5] is complete. We note for future reference that 

2/i(l - 6™ ax ) < *c + M- (3-55) 

Let us now consider the case c = c*(li). By the preceding, we have immediately that 
a max — ^ _ 5 c , anc j tliat 7c* = a c *e 2/ \ It remains to see that 6™ ax = a™ ax or, equivalently, that 
2/i(l-aJ5 ax ) is a solution of /i™ ax (s) = 0. Using the formula for c* in (|2.2p and for ^,^ ax in (|3.54|) . 
the expression of a c * in (|3.2ip and the formula for a™ ax = 1 — 6 C * in (|3.24p via either (|3.19p 
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or ([3720]) . we find that 



/^ ax (2/i(l - a™ ax )) = /^ ax (i c , + fj) 



:7 c ^ 2 e- 2( * c * + ^ + e - (tc * +At) (1 - 2 7c */?) + i c » + fi - 1 + 7c V + c> 2 



2 sinh(/i) 



/ 



sinh(^t) / I ^ sinh(/i) 



; „ , ..j ' +2 \/ 1 sinh 2 (^) +1 sinh 2 (» 2 sinh 2 (/x) 

2sinh(» sinh 2 (X) 7 M 2 \ 2 + sinh 2 (/i) ' 

l^T - 1 



Vsinh 2 ^) J sinh 2 (» 



^ | V Sinh W /i M 2 | ,. 1 

2sinh( M ) ^ sinh( M ) ^ 2 A/ 1 sinh 2 ( M ) ^ ^ 



sinh (/i) 



2sinh(» ~ 2sinh(//) ~ r* 



= 0. 

Therefore, a™ ax = 6j5 ax and by (|2.19p . the last parameter 5 C * is given by 

° c * _ 7? e ' ce 7? e ' c * e _ 2 M sinh( M ) ~ " c 

(for the third equality, use (|3.20p ) . Replacing the value of 7c * and a c * in the general expression 
for V^? ax given in (|2.17p . we finally obtain as in (|3.25j) that, for all x G [0,1], 

V c ^(x, 1) = — + Ml _ e _ 2M) = (x, 1) (3.56) 

and V^ ax (x, -1) = t^P^l - x, 1) from (|2.15h|) . This completes the proof. □ 

3.4 Proof of optimality for the maximization problem 

Now that we have the solution of the free boundary problem (|2.15p . we shall prove that t^, max 
is equal to the value function l/ max and that G c is an optimal control. This will be similar to 
the proof of optimality in the minimization problem. 

Proof of Proposition El The proof is the same as for Proposition [2] □ 
Lemma 13. Let L a denote the operator defined in \3.35\) . Then, for all < c < c*{ji), 

1 + h a V c max (x, a) = 0, for all x G C™ ax , 
1 + h a V c max (x, a) < 0, for all x G D™ ax \ dD 



max 
a 



Moreover, ifc = c*(p), then 

1 + l, a V^ ax {x, a) = 0, for all x G [0, 1]. 
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Proof. The proof follows the same steps as for Lemma [9l In particular, for x G Ja™ 1 ", 6™ ax [ , as 
in Q5J5SD , l + LiF c max (x, 1) = 2/i^g^(x,-l) and 1-x G ] 1 — o™ ax , 1 — a™ ax [ C [0,a™ ax ], and so 

U c max (x, -1) = F c max (l - x, 1) = + 7c (V 2 ^ 1 -*) - 1 

Therefore, 

af/max 

^ 3x~ {x ' _1) = 1 + 2 ^^ e " 2Ml_X) < 1 + V^e 2 ^ = 1 - ^g-je-tc+Z' = tanh(t c ) < 0, 

where we have used the equalities 7 C = a c e 2M < 0, a™ ax = 1 — b c , (|3.2T[> and 2//o c = t c + f/,, and 
the fact that i c < 0. This proves Lemma [T3l □ 

Lemma 14. For all < c < c*(/x) and are?/ a G {—1, 1}, if x G C™ ax , then 

V c max (x, a) > U c ma3; (x, -a) - c. 

Proof. We compare the left- and right-hand sides of this inequality on a case by case basis as in 
the proof of Lemma [lOj In the case where c = c*(fi), the result follows immediately from ()2.16p 
together with (|2.7p . Assume < c < c*(/i) and, without loss of generality, that a = 1. 

Case L If x G [0, 1 - 6™ ax [, then 1 - x G ]6™ ax , 1] and according to (|2.15hl) and OTTj) . 

F--(x,-l)-K max (x,l)-c = ei (x), 

where 

ei (x) := f + <5 C (e 2 ^ - l) - 7c (e" 2 ^ - l) - c. (3.57) 

The sign of the derivative e[(x) = 2{ie~ 2>MX (5 c e 4:llx + [i~ 2 e 2iix + 7 C ) is determined by a quadratic 
function of e 2fMX , which vanishes at most twice on R, at y^, which are given by the formula (|3.40|) 
for xf , but with a c replaced by 5 C and j3 c replaced by 7 C . When 5 C ^ 0, the discriminant 
Ai = 4^1 — is positive since 

Ai ^ 4^ 1 - 4)U 4 <5 C 7 C )0« (l + 2/i 2 7 c e~ 2M{1 "''" ax) ) 2 > 0, 

by d2H2D. Using again (l2~m we see that e'^1 - 6™ ax ) = and so 1 - o™ ax G {yf }. If <5 C > 0, 
then \/Ai > 2 ^ (recall that 7c < 0) and yf is the only root of e[. The point 1 — 6™ ax = yf 
is thus the global minimum of the function e\ and since ei(0) = — c < 0, we have e\{x) < 
for all x G [0, 1 — 6™ ax [. If 5 C < 0, then e\ has two distinct real roots y{~ < yf such that 

2/xyf < log (~2T^) < Using (fimjj) and ([5^7jl . we see that 



J/i 



The last inequality is satisfied since cosh(i c ) < e~ tc because t c < 0, and 2/x(l — 6™ ax ) G ]0, fj, + t c [ 
by (|3.55p . Thus, e\ is strictly decreasing on [0, 1 — 6™ ax [ with ei(0) = — c < and so e\{x) < 
for all x G [0, 1 - 6™ ax [ . Finally, if 5 C = 0, then yf = yj~ = 1 - 6™ ax and e'^x) < if and only if 
x G ]0, 1 — 6™ ax [, and so e±(x) < for all x G [0, 1 — 6™ ax [. Therefore, for all possible values of 
S c , we have shown that e\{x) < for all x G [0, o™ ax [. 

Case 2. If x G [1 - bf ax , 1 - af ax ], then 1 - x G [af ax ,bf ax ] = Df ax and by (|2.15h|l 
and pT5b1) . 

U c max (x, -1) - ? c max (x, 1) - c = U c max (l - x, 1) - ? c max (x, 1) - c = -2c < 0. 
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Case 3. If x G ]1 - a™ ax , a™ ax [, then 1 - x G ]1 - a™ ax , a™ ax [ and by PTTTD . 

F c max (x, -1) - t/ max (x, 1) - c = -c+ + 7c (e 2 ^" 1 ) - e" 2 ^) = -2c + d 2 (x), 

where (^(x) is given by (|3.4ip . Since a™ ax = 1 — b c and since we have seen that ^(O is 
strictly increasing on ]b c , 1 — b c [ with cfoC&c) = 0, and ^(1 — b c ) = 2c by (|3.42|) . we have that 
-2c + d 2 (x) < for all x G ]1 - a™ ax , a™ ax [ . 

Case ^. If x G ]6™ ax , 1], then 1 - x G [0, 1 - fe™ ax [ and by ([2TT7]) . 

y c max (x, -1) - V 6 max (x, 1) - c = -ei(l - x) - 2c, 

where e\ is defined in (|3.57[l . Notice that 

-ei(l - &r x ) - 2c = - (? c max (6r x , 1) " K max (l " C ax , 1) - c) - 2c = 0, 

by (|2.15bj) . It follows from the properties of e\ that we already discussed in part 1 that — ei(l — 
x) — 2c < for all x G ]6™ ax , 1]. This proves the desired inequality in this last case and completes 
the proof. □ 

Let us define K c : R + x [0, 1] x {-1, 1} x N — ► R+ by 

(t,x,a,n) ^ K c (t,x,a,n) := t - cn + V™ ax (x,a). (3.58) 

For A G A, we consider the process K°' A = K c (t,X^,A t ,N t (A)). The next corollary follows 
immediately from Lemma [T4l 

Corollary 15. Let < c ^ c*(/i), Zei G c denote the control satisfying \2. 20\) and let A £ A be 
any admissible control. Then, for all x G [0,1] and a G {—1,1}, T xa -a.s., for all s G K+: (1) 
AKs' GC = 0; (2) AKs' A < 0; f3j AK, C ' A < i/ and on/y if Xf G and A, ^ 

This leads to the following property of the process K C,A . 

Proposition 16. Let G c denote the candidate strategy satisfying H2.20\) . let K c be defined 
by \3.58\) and let c*(fi) be given by i fP)) , J/0 < c ^ c*(fj,), then: 

1. the process (K^ GC )t^>o is a martingale under P XiQ ; 

2. for any A G A, the process (^K^_^ A )t^o is a supermartingale under Px,a- 

Proof. This is established by using Ito's formula together with a local time-space formula, as 
well as Lemma [T3l and Corollary 1151 i n the same way as in the proof of Proposition 1121 □ 

Proof of Theorem [7j The proof is exactly the same as the one of Theorem O using in this case 
the supermartingale property given in Proposition [TBI □ 

4 Further results 

In this last section, we present a result on generic uniqueness of the optimal strategy, as well as 
a scaling property. We also consider the limiting case where c ^ and verify that it is consistent 
with the classical result of [5|. These statements are given only for the minimization problem 
but it is not difficult to see that they are also valid for the maximization problem. At the end 
of this section, we provide illustrations of the value functions of both problems. 

In the minimization problem, strictly speaking, we do not have uniqueness of the optimal 
control in general, since for c = c*(/i), the strategy A c * is equivalent to the constant strategy 
A and both are optimal. It turns out, however, that this is the only case where there are two 
distinct optimal strategies. The case where c > c*{\i) has already been discussed in Theorem [3j 
so we now consider the case c ^ c*{ijl). 
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Proposition 17 (Generic uniqueness). Let < c ^ c*(/i) and let A £ A be a strategy such that 
for some (x,a) E [0, 1] x {—1, 1}, either pi > or < c < c*(p,) and p2 > 0, where 

Pl := P X , Q (3 1 E [0, r A ] : X t A G CU t _ and A t ^ A t _) , 
p 2 :=F x , a (3t e [0,r A [: X A E D At ) . 

Then A is f x ^ a -sub-optimal, in the sense that V c (x, a) < E x , a (t a + cN t a(A)) . 

Remark 18. The condition p\ > means that with positive probability, the strategy A pre- 
scribes at least once to switch drifts in the continuation area of the control A c . The condition 
P2 > means that with positive probability, the strategy A prescribes at least once to continue 
without switching in a switching region of A c . 

Proof. If E Zja (r ) = +oo, then it is clear that E x<a (t a + cN t a(A)) > V c *(x, a). Thus, we can 
assume that E x ^(t a ) < +oo. Suppose first that p\ > 0. Then by Corollary [TTl 

E x>a I AH s A ) >°- 

\0<SSjT A / 

Setting u = in (|3.47p . we find that 

j-tl\T A QT7 

^(X A ,A s )dB s+ Y 

0<s<tAr A 

and taking the expectations, applying the monotone convergence and the dominated convergence 
theorems (recall that V is bounded), we get 



E x 



a (H C T : A ) > H^ A + E x , a I Y AH s' A ) > H A = «)• 

\0<S^T A / 



Since the left-hand side is equal to E XA [t a + cN t a (A)) , this proves the statement when pi > 0. 

Suppose now that p2 > 0. Let A denote Lebesgue measure. Notice that the interior mt(Dj\ t ) 
of D At is not empty for < c < c*(/i). By right-continuity of s i->- A s and because of the irregular 
behavior of sample paths of diffusion processes, on the event {3t E [0,t a [: X A G D At }, 

\{s G [0,r A [: X A G int{D As )} > 0. (4.1) 

Setting u = in ()3.46p and then applying successively Lemma [9] and Corollary [TTJ we get 

H^ A A > H C ' A + jf (X A , A.) dB s + J (1 + h As V c (^, As)) t{x^D Ae} ds. 



Again by Lemma the integrand of the last integral is strictly positive if X A belongs to the 
interior of Da s • Taking expectations in the previous inequality and applying successively the 
dominated and monotone convergence theorems and the hypothesis p2 > with (|4.ip . we find 
that 

E x , a {t a + cN t a{A)) = E x , a (i^f) > H C Q ' A = V c (x, a), 

which concludes the proof. □ 

If we consider a diffusion coefficient <j / 1 for the particle, we can deduce from Theorem [3] 
the corresponding value function and optimal control. Let a > and let (Bt) be a standard 
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Brownian motion, (J-t) be its natural nitration and A be the associated set of strategies. For 
A G A, consider the s.d.e. 

dXf = AtfJ, dt + adB t , X§ = x, (4.2) 
and the corresponding stochastic control problem whose value function is given by 

V{x,a,c,v,a) = mi¥. Xja (r A + cN A (A)), (4.3) 
AeA 

where f A is the exit time of X A from [0, 1] and N(A) is the process that counts the discontinuities 
of A. 

Proposition 19 (Scaling property). The optimal control of problem |^.3| ) is obtained by the 
construction that leads to {2.1$ , but replacing c by a 2 c and fj, by fJ-fcr 2 . The value function 
satisfies 

V(x, a, c, fi, a) = —V ( x, a, ca 2 , —, 1 



where V (x, a, ca 2 , [ija 2 , l) coincides with the value function of problem {l-4\ ) with c replaced by 
ca 2 and fi replaced by [i/cr 2 . 

Proof. Define Bt = aB t / a 2, so that (Bt) is a standard Brownian motion. Setting 

dZ t = ±u dt + adB t , dZ t = ±-^tt dt + dB t , 

and Zq = Zq, we see that Z t = Z a 2 t . 

Let (J-t) be the natural filtration of (Bt), that is, J~t = J't/cj' 2 ^ an d let A be the set of strategies 
associated with (J 7 *). Given A £ A, define A = (A t ) by A t = A t / a 2. This defines a one-to-one 
correspondence between A and A. 

Let dX A = Atiio' 2 dt + dB t , with Xq = x. Then, X A 2t = X A and we see that t a = a 2 f A 
and N a 2 t (A) = N t (A). Therefore, 

a 2 (f A + cN fA (A)^ =t a + co- 2 N t a(A). 

Minimizing the right-hand side is precisely the problem (|1.4p . with c replaced by ca 2 and n 
replaced by ^/o~ 2 . This proves the proposition. □ 

As mentioned in the introduction, in the case where there is no switching cost (c = 0), the 
solution of the control problem corresponding to (|1.4p is now classical (see [5], IV.5]). The value 
function does not depend on the initial drift and is given by 

V(x) = 2 ~ ll ~ x l _ * -m ( e MHM) - l) xe[0,ll. (4.4) 
/x 2fi z \ / 

The optimal control, which would not be admissible in our setting, is given by 

A t = sgn (\ - Xf) , with dX^ = A t fx dt + dB t on {t ^ t a }, (4.5) 

where sgnx = 1 if x ^ and sgnx = — 1 if x < 0. We observe that this control A is not piecewise 
constant, since it corresponds to switching regions given by D 1 = [0, \) and £>_i = [|, 0]. Thus, 
there exists only a weak solution of (|4,5p which is given by Tanaka's formula (see e.g. [3j Sections 
7.3 and 10.4]). In the next proposition, we show that (|4.4|) can be obtained as a limit of V c (x, a) 
as c 10. 



Proposition 20. Let V(x) denote the function defined in {4-4\ l- The solution {V c , a c , b c } of {2.4 
satisfies lima c = ; lim6 c = ^ and lim V c (x,a) = V(x), for all x G [0, 1] and a £ {±1}- 
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Proof. Observe first that when c \, 0, equations (|2.9p and (|2.1ip become respectively 

fA*>-ty(2iix - n - 1) + 2[ix - n + 1 = 0, 

0, 

where ao = ~^i e ~ fl - The unique solution of the first equation is 6o = |, so lim^o fr c = 5- 
The second equation has exactly two solutions, one of which is > \ and the other is ao = 0. 
Since < a c < ^, we deduce that lim c ^ a c = 0. Putting these values into (|2.10p and (|2.12p . 



[i 2 a e 4t " y + (1 - 2^a )e 2m + [?a - - 1 



respectively, we find that when c | 0, a c 
to (ESD, we find that 



27? 



and p c 



2/? 



. Therefore, according 



lim V c (x, a) 



1). 

^ -A* (^(l-z) 
2/^ " V / 

These formulas coincide with (|4.4p and the proof is complete. 




1 



xG [0,±], 
x 6 



1 ll 



2' 



□ 



In Figure [21 we give the graph of the value function of both problems (|1.4p and (|1.5p for two 
possible values of the switching cost (c = 0.01 and c = 0.04) when the intensity of the drift is 
[i=l. In this case, the critical value of the cost is c*(l) ~ 0.058. The numerical value of the 
switching boundaries in the case where c = 0.01 are given by: 



a c rj 0.0882, b c « 0.3426, a™ 
and in the case where c = 0.04, they are given by: 
a c 0.1737, 6 C « 0.2451, a™ 



1 



1 



imax 



0.9387, 



0.8494. 



Because of the symmetry, Figure shows only the value function corresponding to a positive 
initial drift. 



vT(x,i) 




c = 0.04 
M = l 



vT(x,i) 




Figure 2: Graphs of V^, max (x, 1) and V c (x, 1) for two different values of the cost. The dotted 
line is the graph of the function f^(x) defined in (|2.ip . which coincides with the payoff of the 
constant strategy. 
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